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v.  ABSTRACT 

I 

Two  experiments  sought  to  determine  whether >  and  if  so 
hawi  performance  varies  as  a  function  of  the  manner  in  which  a 
progressively  unfolding  decision  problem  is  displayed  over  time.  A 
hurr i cane-track i ng  scenario  was  adapted  to  the  "opti onal -stopping" 
paradigm)  such  that  subjects  elected  to  continue  sampling  information  or 
to  make  a  terminal  decision  (evacuate  or  stay)  at  successive  points  in 
the  storm's  development  based  upon  cumulative  evidence  and  future 
expectations.  The  display  manipulation  was  minimal  in  that  it  applied 
only  to  non-pred i ct i ve  historical  data  (position  information).  Despite 
this  conservative  test)  display  format  had  a  significant  effect  when 
time  pressure  was  involved:  subjects  reached  earlier  and  better  terminal 
decisions  under  the  analog  (graphic)  than  the  numerical  format 
(Experiment  2).  The  differences  reduced  to  nonsignificances  under 
self-pacing  (Experiment  1)>  although  significant  improvements  were 
obtained  by  use  of  a  simple  aiding  device  (calculation  of  "worst  case" 
probabilities).  Results  are  generally  consistent  with  Hammond's 
Cogn i t i ve  Cons i stency 
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INTRODUCTION 

Advances  i n  computer  techno  I ogy  prov i de  the  system  des i gner  w i th 
numerous  options  for  the  visual  encoding  and  display  of  information. 

Even  the  least  soph i stocated  machines  offer  a  variety  of  formatting 
capab i I i t i es  including  both  a  I pha-numer i c  and  graph i c  presentat i on 
modes . 

Considerably  less  advanced >  however)  is  our  understanding  of  how 
best  to  use  these  capabi I ities.  Designers  often  side-step  the  issue  by 
i ncorparat i ng  multiple  modes  and  self-selection  features  into  the 
display  —  in  effect)  leaving  the  decision  up  to  the  user.  While 
flexibility  is  obv i ous I y  the  an  I y  answer  when  the  same  i nt ormat i on  has 
multiple  users  and  uses)  it  can  prove  costly  when  operators  are  under 
speed  and/or  ioad  stress.  Selection  itself  can  take  time  and  "mental 
capacity)"  and  there  is  no  inherent  reason  to  believe  that  users  are 
even  aware  of  which  mode  produces  the  best  results.  Thus>  when  task 
requirements  are  fairly  well  defined)  format  decisions  might  better  be 
programmed  into  the  system  design — if>  in  addition)  the  basic  functions 
relating  format  to  operator  performance  were  known. 

As  we  just  noted)  however)  this  last  "if"  is  a  rather  big  one.  It 
has  long  been  recognized  that  display  format  can  have  a  profound)  though 
task-dependent)  influence  on  human  performance  (Hitt>  1961;  Schultz> 
1961;  Smith)  1963;  Smith  &  Aucella*  1983).  Still  for  relatively  tew 
kinds  of  tasks  could  our  present  knowledge  be  considered  adequate  for 
mak i ng  spec i f i c  des i gn  recommendat i ons .  Notab  I e  except i ons  >  i n  add i t i on 
to  Hitt's  early  map-reading  work)  are  recent  studies  on  look-up  tasks 
(TulliS)  1981)  1983)  1984)  and  on  probabilistic  judgments  (Goldsmith  & 
Schvaneve I dt )  1981;  Wickens  8.  Scott)  1983).  In  the  former)  Tul I  is  has 
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achieved  considerable  success  predicting  keying  performance  and 
subjective  ratings  based  on  six  objective  display  measures.  In  the 
I attar i  subjective  weighting  of  cues  has  been  shown  to  vary  as  a 
function  of  a  I pha-numer i c  vs.  graphic  display  modes. 

The  fact  that  analog  or  graphic  presentation  sometimes  produces 
superior  performance  has  been  attributed  to  "holistic"  processing: 
people  are  able  to  integrate  or  interpret  the  information  in  a  graphic 
display  "at  a  glance"  whereas  they  tend  to  deal  with  a  I pha-numer ics 
sequentially  (Goldsmith  &  Schvaneve I dt *  1981;  Uickens  8.  Scott*  1983). 

In  this  vein*  Hammond  (1980)  has  proposed  that  format  is  one  of  several 
task  features  that  promote  either  an  "analytic"  or  "intuitive"  cognitive 
approach  to  judgment. 

The  present  research  sought  to  extend  the  graphic  (analog)  vs. 
alpha-numeric  comparison  to  another  practically  important  task  domain: 
the  so-ca I  I ed  opt i ona I -stopp i ng  dec i s i on  prob I em .  The  principal 
feature  of  this  task  is  that*  unlike  the  one-shot  decision  problems 
favored  in  laboratory  research*  the  operator  (DM)  acquires  information 
over  time  and  at  cost*  deciding  when  as  well  as  how  to  act.  In 
a  sense*  each  problem  involves  a  sequence  of  decisions*  each  stage  of 
which  requires  a  choice  between  "keep-sampling"  and  "terminal -act ion" 
alternatives.  Cast  and  payoff  functions  are  generally  such  that  DM  can 
reduce  the  uncertainty  of  the  decision  problem  only  at  the  expense  of 
the  marginal  utility  of  his/her  ultimate  choice  (i.e.*  information  is 
costly) . 

The  practical  significance  of  this  kind  of  task  is  that  it 
represents  a  common  decision  situation  in  which  time  is  important*  a 
situation  encountered  in  military*  medical*  political*  legal  and 
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manager ia I  contexts.  A  military  commander  or  corporate  CEO>  tor 
example)  can  be  completely  certain  of  an  adeversary's  intentions  if  he 
or  she  e I ects  to  wa i t  unt i I  all  tact i ca I  opt i ons  have  become  t ut i I e ! 
Though  exaggerated)  this  example  illustrates  a  common  tailing  revealed 
in  both  the  laboratory  and  in  anecdotal  reports  from  "the  fields"  human 
Ofi-’s  tend  to  postpone  action  too  long  (i.e.>  to  oversample)  in  such 
situations  (Connolly  8.  Gilani)  1982!  Her shman  8.  Levine>  1972.  Levinei 
Samet  >  8.  Brah  I  ek  >  1975 ) . 

Given  the  potential  ma I adapt i veness  of  human  sampling  tendencies 
and  the  suggested  advantages  of  the  analog-graphic  display  mode  which 
would  seem  particularly  salient  in  a  progress i veiy  unfolding  scenario 
the  opt i ana  I -stopp i ng  task  appeared  to  represent  an  ideal  vehicle  far 
the  exploration  of  format  effects.  The  aim  of  the  present  studies) 
therefore)  was  to  determine  whether  sampling  tendencies)  decision 
quality)  and/or  decision  efficiency  vary  systematical ly  with  display 
format.  Two  experiments  were  conducted)  one  under  self-paced  and  the 
other  under  forced-paced  conditions.  It  the  two  formats  dD  encourage 
different  cognitive  strategies  <e.g.>  "holistic"  and  "intuitive"  vs. 
"sequential"  and  "analytic"))  then  one  would  expect  time  pressure  to 
exacerbate  any  observed  performance  differences. 

EXPERIMENTS 

The  abject  of  both  studies  was  simply  to  determine  whether 
manipulation  of  display  format  (graphic  vs.  numeric  mode)  alters 
sequent i a  I  dec i s i on  behav i or  i n  a  manner  cons i stent  w i th  the 
hypothesized  differences  in  cognitive  processing.  In  particular)  does 
an  analog  version  of  a  developing  scenario  induce  less  sampling)  faster 
or  more  efficent  proccesing>  and  more  time-sensitive  decision  quality 
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than  tha  numeric  vara  ion  at  tha  same  information?  Exparimant  1  was 
considarad  axp I  oratory  in  that*  daspita  soma  prior  pilot  work*  it  was 
tha  first  full-blown  study  using  a  naw  task  and  methodology.  Thus 
self-pacing  was  usad  rathar  than  pre-selected  timing*  and  a  sacond 
variable  (prasanca  vs. absence  of  a  daeision  aid)  was  crossad  with 
display  format  in  an  attampt  to  define  kay  task  paramatars  far  usa  in 
subsequent  stud i as. 

Exparimant  2  was  tha  immadiata  beneficiary  of  this  deve I opmenta I 
work.  Forced  pacing  was  introduced  and  manipulated  on  tha  basis  of 
Experiment  1  results.  In  most  other  respects*  however*  the  methodology 
for  tha  two  studies  was  identical.  Consequently*  the  common  features 
will  be  described  first  followed  by  a  separate  account  of  Experiments  1 
and  2. 

COMMON  PETHOO 

Subjects 

A  total  of  92  undergraduates  recruited  from  psychology  courses  at 
Rice  University  participated  in  ana  of  tha  two  studies.  Each  served  tor 
one  or  two  experimental  sessions  in  exchange  tor  course  credit  or  $4.00 
per  session.  The  sexes  wars  represented  approximately  equally  in  all 
groups*  otherwise  assignment  was  randomized.  Experiment  1  called  for  56 
subjects!  Experiment  2*  for  36. 

Task 

Each  subject  was  required  to  monitor  a  series  of  simulated 
hurricanes  in  their  advance  toward  a  heavily  populated  target  area 
(city).  Storm  paths  were  described  with  reference  to  an  8  (longitude)  x 
7  (latitude)  grid  as  illustrated  in  Figure  1.  They  progressed  from  left 
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Insert  Figure  1  about  here 

(longitude  7)  to  right  (longitude  0)  in  step-wise  fashion*  and  subjects 
were  required  to  make  one  of  three  responses  after  each  advance: 
wait  (i.e.*  postpone  any  terminal  action)*  evacuate  (i.e.*  order 
total  abandonment  of  the  city)*  or  stay  (i.e.*  minimize  the 
potential  lasses  associated  with  decision  delay  as  in  committing  to 
intensified  protective  measures  rather  than  retreat). 

Uncertainty  in  the  storm-1  s  path  was  introduced  by  building  into 
each  advance  a  .3  probability  of  unit  latitudinal  movement  in  either 
direction  (thereby  setting  the  probability  of  its  remaining  at  the  same 
latitude  equal  to  .4).  The  net  result  of  this  feature  was  that  the 
modal  ending  paint  of  the  population  of  storms  was  the  target  location* 
but  the  a  priori  prababi I ity  of  this  occurrence  was  low  (p= 

.190).  For  purposes  of  simplicity*  the  value  components  of  the  task 
were  all  translated  into  a  common  I i ves  I ast  index.  Waiting  reduced 
the  effect i veness  of  subsequent  evacuat i on  and  added  a  sma I  I  progress i ve 
lass  of  its  awn!  staying  carried  a  huge  loss  if  the  storm  hit  the  city* 
but  none  of  it  did  not;  evacuating  averted  this  maximum  loss*  but  was 
more  costly  as  time  grew  short.  The  specific  functions  used  were  as 
fol lows: 

Waiting  =  0  I ives  per  advance  for  longitude  7-5* 

20  lives  per  advance  for  longitudes  4-1. 

Stay i ng  =  1500  lives  if  hit*  0  if  not 

Evacuat i on  *  300  +  C3(8  -  Longitude) 3  lives. 

Briefly*  then*  the  subject's  task  was  to  decide  when  to  stop 
gathering  information  and*  at  that  paint*  which  action  to  take  based 
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upon  (a)  the  stamps  current  location*  and  (b)  the  subjective 
expectat i on  of  costs  assoc i ated  w i th  the  var i ous  opt i ons  i n  that 
situation.  The  subject  observed  the  entire  course  of  each  hurricane 
toward  it's  final  (Latitude  □)  destination.  However*  instructions 
emphasized  that  there  would  be  a  number  of  storms  to  monitor*  and  that 
the  subject  should  attempt  to  minimize  the  loss  of  life  over  the 
entire  session.  It  was  explained  that  because  hurricanes  are  not 
completely  predictable*  the  "best"  decision  would  not  always  result  in  a 
favorable  outcome*  and  "poor"  ones  would  sometimes  win  out.  Since  these 
fluctuations  would  even  out  over  the  course  of  a  session*  the  subject 
was  advised  to  concentrate  on  long-run  consequences.  To  reinforce  this 
perspective*  a  cumulative  lass  "score"  was  maintained  and  displayed 
continuously  aver  the  session. 

The  formal  structure  of  the  task*  as  just  described*  produced  the 
expected  lass  pattern  shown  in  Table  1.  The  values  were  chosen  in  a 
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manner  designed  to  avoid  the  "flat  maximum  problem"  (i.e.*  a  structure 
in  which  most  of  the  options  produce  very  similar  marginal  results)*  and 
to  distribute  the  "correct"  decision  over  the  options  in  a  fairly 
realistic  fashion  (i.e.*  early  waiting  followed  by  evacuat i on  or 
stay i ng  depending  on  location).  Whereas  subjects  were  carefully 
instructed  in  the  loss  functions  associated  with  the  three  options  and 
the  rule  governing  probability  of  latitude  shifts  (i.e.*  p  =  .3*  .4* 


.3)*  they  were  not  shown  the  actual  values  in  Table  1. 
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The  display  was  used  primarily  to  indicate  the  present  location  and 
history  of  each  storm.  The  format  manipulation  involved  an  analog 
representation  as  illustrated  previously  (see  Figure  1)  and  a  numeric 
representat i on  as  shown  in  Figure  2.  In  both  cases  a  cumulative  lass 
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record  for  the  session  was  displayed  in  identical  alpha-numeric  farm  at 
the  bottom  of  the  CRT. 

It  should  be  noted  that  in  the  present  version  of  the  task*  a  Monte 
Carla  procedure  was  used  to  generate  storm  paths.  Thus  there  was  no 
reliable  trend  information  in  the  historical  "track"  of  a  hurricane. 

One  wauld>  of  course/  expect  an  analog  format  to  be  most  advantageous 
when  such  information  exists*  and  we  intend  to  explore  that  possibility 
in  future  research.  For  present  purposes*  however*  the  intent  was  to 
focus  on  the  most  rudimentary  aspect  of  the  displayed  information 
(current  position) — an  aspect  far  which  there  would  be  na  i nherent 
advantage  favoring  the  analog  mode.  In  fact*  if  anything*  the  analog 
mode  was  considered  to  be  at  a  s I ight  disadvantage  in  that*  based  on 
their  extra-experimental  experience*  subjects  might  be  encouraged  to 
read  more  into  the  "tracks"  than  the  data  warranted. 

A  final  aspect  of  the  task  used  in  one  condition  of  the  first 
experiment  was  a  decision  aiding  feature.  This  feature  consisted  of 
presenting  the  subject*  at  each  point  in  each  problem*  with  an  updated 
calculation  of  the  probab i I i t i es  of  the  storm  hitting  the  city  from  its 
current  position  and  each  remaining  position  that  it  could  assume.  This 
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information  was  also  presented  numerically*  but  on  a  separate  display 
from  the  position  information. 

St i mu  I i  and  Apparatus 

Patterns  of  storm  movement  were  generated  randomly  within  the 
constraints  noted  earlier  using  a  Monte  Carla  procedure.  A  TRS-QO  Model 
2  microcomputer  controlled  the  stimulus  presentat ion*  displayed  the 
information  (on  its  CRT)*  and  recorded  the  performance  measures  (when* 
where*  and  what  response  was  made).  The  program  was  designed  such  that 
each  response  resulted  in  a  display  of  the  option  selected*  an  update  of 
the  storm's  progress  (one  step  to  the  right)*  and  a  repetition  of  the 
three  response  apt i ans  far  the  new  pas i t i an .  Fallowing  a  term i na I 
dec i s i on  (stay  or  evacuate)*  the  updates  continued  automatically  at 
a  deliberate  pace  until  the  storm's  ultimate  disposition  was 
established.  At  that  point*  the  session  "score"  was  updated  and*  after 
a  brief  delay*  the  next  storm  was  introduced. 

EXPERIMENT  1 

Des i an  and  Procedure 

Two  variables  at  two  levels  each  were  combined  factorial ly  in  a 
between-group  design.  Display  format  (numeric  vs.  graphic)  was  crossed 
with  aiding  (present  vs. absent)  to  form  tour  groups  of  14  subjects  each. 
As  noted  earlier*  the  aiding  manipulation  involved  making  available  to 
subjects  the  simple  probability  of  the  storm  hitting  the  city  from  each 
rema i n i ng  I ocat i an  . 

Each  subject  tracked  50  storms  in  a  single  session.  The  first  10 
constituted  a  block  of  practice  trials.  Following  a  short  break*  the  40 
experimental  trials  proceeded  in  blocks  of  13*  13  and  14  respectively 
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with  similar  breaks  introduced  after  the  13th  and  2£th  trials.  The 
entire  process!  including  the  initial  explanation!  required  slightly 
more  than  one  hour.  Although  generated  randomly  (see  above)!  the  same 
set  of  storm  patterns  was  administered  to  each  of  the  four  groups!  with 
order  of  appearance  balanced  across  groups.  This  was  done  to  control 
for  the  possibility  of  specific  pattern  and  sequence  effects. 

Three  principal  measures  were  taken:  (a)  information  sampling! 
or  the  point  at  which  a  terminal  decision  was  reached;  (b)  dec i s i on 
accuracy!  or  the  correspondence  of  DM;s  response  tD  that  of  the  EV 
maximization  model  at  each  choice  point;  and  (c)  I atency >  or  the 
delay  between  the  display  update  and  the  key-entered  decision  at  each 
cha ice  paint.  Ulh i I e  subjects  were  aware  that  a  I  I  three  were  be i ng 
recorded!  that  overt  calculations  were  prohibited!  and  that  unnecessary 
delays  were  to  be  avoided!  the  emphasis  was  on  decision  quality  rather 
than  speed .  For  purposes  of  ana  lysis!  these  measures  were  summar i zed  i n 
var i ous  ways  as  descr i bed  i n  the  next  sect i on . 

RESULTS  AND  DISCUSSION 

Oi splay  effects 

No  significant  main  effects  or  interactions  attributable  to  the 
format  difference  were  obtained  on  any  of  the  measures.  This  is  not  too 
surprising  given  the  minimal  amount  of  information  that  was  subject  to 
format  man i pu I  at i on!  the  lack  of  time  pressure;  the  emphasis  on 
accuracy!  and  the  performance  variability  typical  of  such  tasks.  As 
indicated  earlier:  the  main  purpose  of  the  study  was  to  establish  a  set 
of  task  conditions  within  which  we  might  explore  the  format  variable  in 


a  meaningful  way!  not  in  the  format  variable  itself. 
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Despite  these  limitations)  however)  there  were  some  indications 
that  format  is  worthy  of  study.  For  example)  subjects  tended  to  sample 
mare  information  (i.e.)  to  postpone  a  terminal  decision  longer)  under 
the  alphanumeric  display  (a  mean  of  5. IS  vs.  4.95  terns))  and — at  least 
in  the  aided  condition  —  to  respond  more  slowly  (mean  RT  ■  521  msec  vs. 
466  msec).  Since  the  two  formats  produced  virtually  identical  levels  of 
accuracy  (77.2%  for  graphic  vs.  76.8%  for  alphanumeric))  the  implication 
is  that  the  alphanumeric  mode  induced  less  efficient  processing. 

However)  it  benefited  more  consistently  from  aiding  than  did  the  graphic 
condition)  which  showed  almost  none.  In  the  case  of  terminal 
("evacuate"  or  "stay")  decisions)  the  additional  information  provided  by 
aiding  increasesd  response  latency  by  an  average  266  msec,  for  the 
alphanumeric  display  but  not  at  a  I  I  for  the  analog  display)  an 
interaction  that  approached  significance)  F(l)52)  -  2.6B>  p  -  .075. 

Taken  together)  these  tendencies  appear  consistent  with  the 
"ha I i st i c-ana I y t i c"  processing  distinction)  although  by  no  means 
constituting  substantial  evidence  for  it. 

Other  task- induced  effects.  As  has  been  reported  in  previous 
research)  (e.g.)  Hershman  &  Levine)  19705  Levine  et  al.>  1975)  subjects 
tended  to  postpone  a  term i na I  dec i s i on  beyond  the  opt i ma I  stopp i ng  po i nt 
(defined  as  that  position  at  which  EV  for  "act"  first  exceeds  that  tor 
"wait").  The  mean  difference  between  actual  and  optimal  points  of 
action  was  +.39>  a  difference  significantly  above  zero*  t(55)  =  3.54)  p 
<  .001.  Interestingly)  sampling  tended  to  increase  significantly  rather 
than  decrease  over  trial  blocks)  while  performance  accuracy  and  latency 
both  improved  significantly  (see  Table  2). Thus )  what  might  be  construed 
as  overcautiousness  from  the  perspective  of  an  ideal  processor  may 
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actually  have  been  ciose  to  optimal  for  the  human  processor)  DMJs 


Insert  Table  2  about  here 


appeared  to  make  good  use  of  the  "oversampled"  information.  The  fact 
that  subjects  sampled  more  and  became  more  efficient  with  practice  also 
suggests  that  they  took  the  task  seriously  and  did  not  succumb  to 
boredom  effects  as  has  been  reported  in  some  earlier  studies  (e.g.) 
Levine>  et  a  I . >  1975).  Responding  thoughtlessly  or  car  less  I y  simply  to 
"get  it  over  with"  would  have  produced  declining  peformance  over  blacks. 

The  present  data  support  an  earlier  finding  by  Levine  et  a  I .  (1975) 
that  terminal  decisions  are  slower  than  sampling  decisions.  In  the 
present  study  the  difference  was  highly  significant  even  without 
including  the  ear  I i er  storm  pos i t i ons  where  v i tua I  I y  all  cho i ces  were  to 
"wait"  and  were  made  very  fast  (thereby  inflating  the  "wait"  vs. 
"terminal"  decision  latency  difference).  A  more  meaningful  and 
conservative  comparison  limited  to  the  last  tour  storm  positions  yielded 
mean  latencies  of  51Q  msec,  tor  waiting  and  712  msec,  tor  terminal 
decisions)  F(l)51)  *  6.93)  p  <  .012. 

Finally)  the  presence  of  a  decision  aid  raised  the  mean  accuracy  of 
all  decisions  from  75.257*  to  79.507.)  a  difference  significant  at  F(l>52) 
»  6.66)  p  *  .011.  Of  course  these  mean  values  also  reflect  the 
disproportionate  influence  of  early)  easy  "wait"  decisions!  by  contrast) 
accuracy  for  the  critical  last  four  positions  averaged  55.007.  and  62.707. 


tor  unaided  and  aided  conditions  respectively)  F(l)52)  =  6.12>  p<.017. 
While  mean  latency  for  the  aided  decisions  in  these  positions  averaged 
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122  msac  longer  than  for  the  unaided  ones*  and  the  difference  was 

principally  vested  in  the  numeric  display  mode*  neither  effect  was 
statistical ly  reliable  (although*  as  noted  earlier*  the  interaction 

approached  s i gn i f i cance ) . 

The  main  conclusions  to  be  drawn  from  Experiment  1*  then*  are  (a) 

that  the  hurricane  tracking  task  constitutes  a  promising  vehicle  for 

exploration  of  display  format  and  other  design  variables  on  sequential 

decision  behavior*  (b)  that  aiding  can  improve  accuracy  but  at  a  cost  in 

time*  (c)  that  the  range  of  conditions  over  which  forced  pacing  can 

meaningfully  be  introduced  into  the  task  extends  roughly  from  .3  sec.  to 

2.0  sec.  per  decision*  and  (d)  that  the  tendency  to  "oversamp I e"  or 

postpone  term i na I  act  ion  in  opt i ana  I  stopp i ng  is  not  necessar i I y 

maladaptive  from  the  human  perspective.  In  additions  despite  the 
absence  of  conditions  (especially  time  pressure)  that  would  be  expected 

to  i nduce  display  format  of  facts  >  nons » gn i f i cant  trends  cons i stent  w i th 

such  effects  did  appear.  The  second  study*  therefore*  was  designed  to 

provide  an  explicit  test  of  the  format  variable  by  introducing  forced 

pac i ng . 

EXPERIMENT  2 

Dfs  jgn  and  Procedure 

The  chief  differences  between  this  study  and  Experiment  1  were  that 

the  display  format  variable  was  manipulated  within  subjects*  forced 
pacing  was  introduced  as  a  between-subjects  variable*  and  (in  view  of 

its  demands  an  processing  time)  the  aid  was  not  used.  The  design  was 
thus  a  mixed  model  involving  the  factorial  combination  of  display  format 

(analog  vs. numeric)  x  order  of  display  administration  (AN  vs.  NA)  x 
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trial  blacks  (3)  x  tima  stress  (300*  7QQ>  and  1630  msec/update).  Twelve 
subjects  were  assigned  randomly  to  each  of  the  three  pacing  groups. 

The  procedure  was  i dent i ca I  to  that  used  i n  Exper i ment  1  except 
that  more  practice  trials  were  administered  (13)>  and  more  storms  were 
included  in  each  experimental  block  (29).  Since  the  total  number  of 
trials  was  increased  from  50  to  20D >  (100  trials  per  display  mode)*  each 
subject  participated  in  two  sessions  rather  than  one.  The  first 
included  instructions*  practice*  and  the  first  three  experimental 
blocks*  the  second*  the  last  three  blacks  plus  the  debriefing.  All 
trials  in  a  given  session  were  performed  under  one  of  the  two  formats. 

RESULTS  01 SCUSSION 

Display  Effects 

Under  the  pressure  of  farced  pacing*  both  stopping  point 
(information  sampling)  and  decision  accuracy  were  influenced  in  the 
predicted  ways  by  the  display  format  manipulation.  The  pattern  of  these 
effects  is  best  understood  by  considering  together  the  analyses  of 
overa I  I  decision  accuracy*  late  decision  accuracy  (i.e.  the  last 
four  longitude  positions)*  and  samp  I i nn  (see  Tables  3  and  4).  Since 
timing  was  control  led*  latency  was  no  longer  a  sal ient  index. 


Insert  Tables  3  and  4  about  here 


Looking  first  at  the  accuracy  measures*  it  is  apparent  that  the 
analog  format  produced  consistently  superior  performance*  particularly 
under  the  more  stressful  pacing  conditions  and  in  the  critical  later 
stages  of  each  storm  (i.e.*  the  last  four  positions  where  both  terminal 
and  sampling  decisions  were  well  represented) .  In  the  overa I  I 
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analysis  (Tab  I  a  3a)  whera  storm  position  (early  vs. lata)  was  included  as 
a  separata  variable*  it  is  clear  that  the  effect  was  limited  primarily 
to  the  later  decisions.  In  fact*  early  decision  accuracy  was  near 
perfect  since*  as  noted  previously*  the  tendency  during  the  storm's 
formative  stages  was  to  postpone  action*  a  decision  that  was  almost 
always  correct  (95X  overall).  This  ceiling  effect  did  not  operate  in 
the  later  stages  since  the  subject  had  to  give  serious  consideration  to 
all  three  options*  and  mean  accuracy  dropped  to  5Q?«.  Combining 
insensitive  early  positions  with  sensitive  later  ones*  the  main  effect 
of  format  was  reduced  to  nonsignificance  (p*.Q98)*‘  by  contrast* 
separating  early  and  later  positions  revealed  highly  significant 
(p<.001)  position  and  position  x  format  interaction  effects.  The  format 
x  stress  interaction  was  also  sufficiently  robust  to  withstand  the 
diluting  influence  of  early  positions  <p  ■  .014.)*  indicating  that*  as 
expected*  the  analog  superiority  was  limited  to  the  more  stressful 
conditions.  In  fact*  the  overal I  accuracy  under  the  slowest  condition 
was  similar  to  that  under  self-pacing  (Experiment  1)  where  it  wi I  I  be 
recalled  there  was  no  significant  format  effect. 

A  separate  analysis  of  accuracy  for  later  decisions  (i.e.*  those 
made  during  the  last  four  storm  positions)  revealed  a  highly  significant 
format  effect  (p  <  .001*  see  Table  3b).  However*  despite  the  fact  that 
the  analog  superiority  again  seemed  more  pronounced  under  the  more 
stressful  conditions*  the  format  x  stress  interaction  failed  to  reach 
significance  (p*.39).  A  passible  explanation  is  that  since  format  was 
manipulated  within  subjects*  order  of  presentation  may  have  moderated 
the  effect  sufficiently  to  have  obscured  the  interaction.  The  marginal 
significance  of  the  second-order  interaction  (p=.064)  supports  this 
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possibility.  In  any  case*  given  the  results  tram  the  overall  analysis 
and  from  the  self-pacing  condition  employed  in  Experiment  1*  the  most 
conservat i ve  cone  I  us  I  on  is  that  ana  I og  super i or i ty  is  more  likely  to 
occur  when  time  pressure  is  involved  than  when  it  is  not. 

Turning  to  the  samp  I i ng  data*  Table  4*  it  is  apparent  that* 
once  again*  the  overall  tendency  was  to  aversample  (see  Table  4b)  in 
this  case  by  an  average  of  1.4?  updates*  or  nearly  a  fourfold  increase 
over  that  for  Experiment  1  (i.e.*  Q.39).  Thus*  the  mere  exsistence  of 
time  pressure  for  making  individual  decisions*  and  the  consequent 
reduction  in  opportunity  to  process  the  available  information*  appears 
to  have  caused  subjects  to  seek  more  i nformat ion.  As  in  Exper i ment  1  * 
the  trend  was  far  sampling  to  i ncrease  with  experience*  but  in  this 
case  the  effect  was  limited  to  the  numeric  format  (the  format  x  trial 
b I ocks  i nteract i on  was  highly  s i gn i f i cant ) .  There  was  a  I  so  a  tendency 
for  stress  level  to  moderate  the  effect*  but  this  influence  was  neither 
systematic  nor  easily  i nterpretab I e .  The  safest  conclusion  with  respect 
to  display*  therefore*  is  that  the  numerical  format  promotes  an  increase 
in  sampling  over  trial  blacks*  but  that  this  format  effect  is  a 
relatively  smal I  modulation  in  a  very  large  tendency  tor  time  stress  to 
promote  oversampling.  Since  overall  accuracy  was  about  77*  I ower 
than  for  the  comparab I e  cond i t i on  in  Exper i ment  1 >  this  dramat i c 
increase  in  oversampling  does  not  appear  to  have  been  very  productive. 
Moreover*  the  absence  of  any  positive  relationship  between  the 
conditions  that  increased  sampling  and  improved  performance  in  the 
present  study  suggests  that*  unlike  Experiment  1*  stress- i nduced 
oversampling  is  not  functional.  Apparently  people  are  not  able  to  make 
good  use  of  the  additional  information  that  they  feel  they  need.  In 


Schwartz  and  Howal I 


16 


contrast*  it  will  ba  rscal lad  that  thay  did  make  good  usa  of 

"oversamp I ed"  information  undar  tha  non-stressful  salt-pacing  conditions 

of  Exper i mant  1 . 

Othar  Task-inducad  af tacts.  As  may  be  saan  in  Table  3*  the 
time-stress  manipulation  produced  a  systematic  decrease  in  accuracy* 
part i cuar I y  for  tha  latar  (more  sensitive)  decision  positions  (Table 
3b).  Tha  main  affect  of  this  variable  was  highly  significant  in  both 
ana  I ysas *  as  was  i ts  i nteract ion  with  pos i t i on  in  tha  overa I  I  ana  lysis. 
While*  as  noted  previously*  forced  pacing  par  se  apprears  to  have 
induced  a  substantial  increase  in  the  tendency  to  oversampie  (0.39  vs. 
1.49  updates)*  the  specific  rate  of  farced  pacing  did  not  yield  a 
signf leant  main  effect  on  either  sampling  measure  (see  Table  4).  The 
update  rata*  did*  however*  amplify  tha  format  affect  significantly  as 
discussed  earlier. 

GENERAL  CONCLUSIONS 

If*  as  hypothesized*  analog  representation  of  an  evolving  decision 
problem  ancouragas  a  more  "holistic"  processing  strategy  (or  conversely* 
numeric  raprasantat i on  a  more  "analytic"  one)*  we  would  expect  better 
performance  with  an  analog  format  as  time  pressure  exceeded  soma 
critical  level.  This  expectation  was  borne  out  in  the  present  findings. 
Undar  self-pacing  and  tha  lowest  forcad-pac i ng  conditions*  format  had 
little  affect  on  decision  accuracy*  at  higher  levels  of  time  stress*  a 
significant  analog  superiority  emerged. 

While  one  might  argue  that  the  obtained  accuracy  differences* 
though  statistical ly  significant*  were  relatively  small  (on  the  order  of 
5-6%  in  the  critical  later  positions)*  it  should  be  recognized  that  the 
experimental  test  was  intentionally  very  conservative.  The  only 
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information  that  was  subject  to  tha  format  manipulation  was  the 
progressiva  location  of  the  storm;  there  was  no  predictability  in  its 
"track"  or  path.  Since  such  information  (i.e.*  spatial  trends)  would 
naturally  favor  an  analog  format >  one  can  only  expect  the  differences 
obtained  here  to  become  magnified  under  the  more  realistic  task 
situation.  What  the  present  studies  show>  then*  is  that  display  format 
can  affect  decision  performance  in  very  subtle  ways.  Not  only  can  it 
bring  out  aspects  of  a  data  set  (such  as  trend  information)  that  are 
otherwise  difficult  to  perceive — the  well-established  and  relatively 
obvious  "campat ibi I i ty"  phenomenon — it  can  alter  the  decision  maker ‘s 
whole  approach  to  information  processing.  In  a  sense  it  can  alter 
his/her  processing  "set." 

Another  noteworthy  finding  involved  sampling  behavior.  Consistent 
with  previous  studies>  the  present  results  again  revealed  a  tendency  for 
subjects  to  delay  action  beyond  the  optimal  decision  point — in  effect* 
to  buy  too  much  i nf ormat i on .  However  *  these  f i nd i ngs  qua  I i ty  the 
generalization  in  several  important  respects.  First*  a  numeric  format 
tends  to  amplify  the  effect.  Secondly*  the  oversampling  effect  may  not 
always  be  as  maladaptive  as  it  seems*  particularly  it  one  takes  the 
decision-maker  rather  than  an  "abjective"  model  as  the  point  of 
reference.  That  is*  the  overall  effectiveness  of  human  decisions  can 
improve  beyond  the  point  where  an  "ideal  decision-maker"  would  stop 
sampling.  Lastly*  however*  the  present  data  suggest  that  under  time 
pressure*  the  tendency  toward  ma I adat i ve  oversampling  increases. 

Under  the  non-stressful  conditions  of  Experiment  1*  subjects  seemed  to 
derive  real  value  from  the  information  they  received  after  they  "should 
have  acted*"  whereas  under  the  stressful  conditions  of  Experiment  2* 
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thair  performance  did  not  improve  at  all  as  a  result  of  such 
information.  Admittedly*  the  evidence  for  this  last  conclusion  is 
circumstantial  at  best — the  present  work  was  not  directed  explicitly 
toward  this  issue.  Nonetheless*  it  would  appear  sufficiently  important* 
theoretically  as  well  as  practically*  to  warrant  further  investigation. 
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TABLE  1  (Conti nuad) 

Tha  Expactad  Loss  Assoc iatad  with  aach  Response  Option  at  tha  various 
Hurricana  Positions* 


i tvda 

Ujpg.ll 

:ude 

Response 

Option 

272 

288 

310 

358 

400 

560 

Stay 

s 

265 

281 

308 

336 

373 

580 

Wa  i  t 

312 

327 

348 

395 

448 

507 

Evacuate 

.  . 

187 

178 

182 

175 

60 

Stay 

6 

• 

187 

192 

194 

194 

80 

Uait 

• 

327 

348 

395 

448 

507 

Evacuate 

.  • 

, 

77 

61 

40 

60 

Stay 

7 

• 

■ 

97 

81 

60 

80 

Uait 

348 

395 

448 

507 

Evacuate 

#Values  ara  roundad  to  the  nearest  unit. 
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Tab  I  a  2 

Maan  Performance  over  Trial  Blocks  for  the  Three  Principal  Measures 
(Experiment  1) 


Measure  Trial  Blocks  Si qn i f i cance  Test 

12  3 

1.  Stopping  point  4.92  5.04  5.23  F(2>  104)  —  5.00*  g<.009 

(no.  of  observations) 

2.  Accuracy  767.  767.  BO 7.  F(2>  104)  =  3.B7,  E=0.D24 

3.  Latency(ms)#  608  450  351  F(2*  104)  =  149.46*  e^D.QOI 


#  I nc I udes  both  samp  I i ng  and  term i na I  dec i s i ons  over  a  I  I  pos i t i ons . 

Since  earlier  and  sampling  ("wait")  decisions  tar  outnumber  later  and 
terminal  decisions*  and  the  former  tend  to  be  about  200  ms.  shorter  than 
the  latter*  these  means  are  biased  toward  the  shorter  latencies  (see 


text ) . 
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Table  3 

A  Summary  of  Major  Display  Effects  Expressed  in  Percent  Correct 
(Experiment  2) 

A.  OVERALL  ACCURACY 


Stress  Leyel  (Updates/sec) 


Display  Storm 

Format  Position 


Ear  ly 

92 

96 

93 

94(3) 

Ana  1 09 

Late 

50 

53 

47 

53 

Mean 

75 

75 

70 

73 

Ear  1  y 

98 

95 

94 

96 

Numer  i  c 

Late 

57 

45 

42 

47 

Mean  77 


(1)  Stress  F(2,  30)  =  4.68.  E=0.017 

(2)  Format  F(l,  30)  -  2.92,  £=0.070  (ns) 

(3)  Position  F(l,  30)  =  1060.56,  E<0.001 

(4)  F  x  S  F(2,  30)  =  4.92,  e=0.014 

(5)  F  x  P  F( 1 ,  30)  =  12.40,  E=0.001 
<6)  S  x  P  F(2,  30)  =  5.92,  E=0.007 
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B.  LATE  ACCURACY 


Stress  Level  ( Updates /s> 

Display 


Format 

.4 

1 

.4 

AM 

60 

52 

47 

Analog 

NA 

56 

56(3) 

S3 

53 

46 

Mean 

56 

53 

AN 

56 

51 

43 

Numer i c 

NA 

55 

57 

38 

45 

41 

Mean 

57 

45 

Mean 

57 

4? 

(1)  Format  F(l,  30)  =  15.47,  g<0.001 

(2)  Stress  F<2,  30)  =  11.64,  g<0.001 

(3)  F  x  S  F(2,  30)  =  2.11,  £=1.37  (ns) 

(4)  F  x  S  x  Order  F<2,  30)  *  3.00,  g=0.0M  (ns) 
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Table  4 

Summary  of  Major  Sampling  Effects  ExpressedNumber  of  Updates  Prior  to  a 
Terminal  Decision  (Experiment  2) 


A.  ACTUAL  SAPLING 


Stress  Level  (Updates/sec) 


Display  Trial 


Format 

Block 

.6 

1.4 

3.3 

Mean 

1 

4.72 

5.04 

5.00 

4.92(2) 

Analog 

2 

4.66 

5.05 

5.01 

4.91 

3 

4.66 

5.00 

4.66 

4.91 

Mean 

4.75 

5.03 

4.96 

1 

5.17 

4.70 

4.67 

4.91 

Numer i c 

2 

5.49 

4.91 

5.09 

5.16 

3 

5.51 

4.72 

5.30 

5.18 

Mean 

5.39 

4.7B 

5.08 

Mean 

5.07 

4.90 

5.02 

(1)  Format  x  Stress  F(2»  30)  *  4.38>  g=0.021 
<2)  Format  x  Trials  F(2>  60)  *  3.58j  g=0 . 034 
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8.  (X€RSAMPLING  (ACTUAL-OPTIMAL) 


Stress  Level  (Updates/s) 


Display 

Format 

Tr  ial 

Block 

.6 

1.4 

3.3 

Mean 

1 

1.02 

1.17 

2.15 

1.45 

Analog 

2 

.80 

1.05 

1.40 

1.08 

3 

1.82 

.71 

1.78 

1.44 

Mean 

1.22 

.90 

1.78 

1.72 

1 

1 .57 

1.53 

1.38 

1.49 

Numer i c 

2 

2.17 

1.33 

1.59 

1.70 

3 

2.11 

1.74 

1.48 

1.78 

Mean 

1.95 

1.54 

1.48 

1.66 

Mean 

1.58 

1.26 

1.63 

1.49 

(1)  Format  F(l>  IS)  »  3.39;  p=D. 065  (ns) 

<2>  F  x  Stress  F(2>  15)  »  3.08;  £=0.076  (ns) 

(3)  F  x  Trials  F(2,  30)  »  7.45;  E<0.003 

(4)  S  x  T  F(4;  30)  *  4.36;  £<0-007 

(5)  F  x  S  x  T  F<4>  30)  *  7.22;  E<0.001 
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Errata  for  Technical  Report  *84- 1 

Optional  StOODinc  Performance  Under  Graphic  and  Numeric  CRT  Formatting 

Due  to  clerical  error ,  an  early,  unedited  version  of  Technical  Report  *  84- 1  ( Office  of  Naval 
Research  Contract  •  NOOO 1 4-82-C-000 1 ,  Work  Unit  NR  1 978-074)  was  released  and 
distributed  Upon  receipt  of  this  errata  statement,  Technical  Report  *84- 1  should  be 
considered  complete.  The  statement  includes  the  following: 

1)  The  evacuation  cost  formula  on  page  7  should  read 

Evacuation  -  300  ♦  13  X  (8  -  longitude)]2  lives. 

2)  Figures  1  and  2. 

3)  Tables  1 , 3a,  3b,  4a,  and  4b. 

4)  Contrary  to  the  report's  running  head,  David  R.  Schwartz  is  its  sole  author. 
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LATITUDE 
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ABLE  1 


The  Expected  Loss  Associated  with  each  Response  Option  at  the  Various 
Hurricane  Positions* 


Latitude 

Longitude 

Response 

i 

6 

1 

4 

3 

2 

_1_ 

Option 

• 

• 

• 

77 

61 

40 

60 

Stay 

1 

• 

• 

• 

97 

81 

60 

80 

Wait 

• 

e 

• 

348 

395 

448 

507 

Evacuate 

• 

187 

178 

162 

175 

60 

Stay 

2 

• 

• 

187 

192 

194 

194 

80 

Wait 

• 

• 

327 

348 

395 

448 

507 

Evacuate 

• 

272 

288 

310 

358 

400 

560 

Stay 

3 

• 

265 

281 

308 

336 

373 

580 

Wait 

• 

312 

327 

348 

395 

448 

507 

Evacuate 

286 

307 

334 

371 

440 

550 

660 

Stay 

•4 

278 

298 

325 

360 

403 

507 

680 

Wait 

303 

312 

327 

348 

395 

448 

507 

Evacuate 

TA8LF  1  (Continued) 

The  Expected  Loss  Associated  with  each  Resoonse  Ootion  at  the  Various 
Hurricane  Positions* 


Latitude 

/ 

6 

Longitude 

5  4 

3 

2 

Response 

Option 

“ 

« 

272 

2«a 

310 

358 

400 

560 

Stay 

5 

265 

281 

308 

336 

373 

580 

Wait 

• 

312 

327 

348 

395 

448 

507 

Evacuate 

• 

• 

187 

178 

182 

175 

60 

Stay 

6 

• 

187 

192 

194 

194 

80 

Wait 

• 

• 

327 

348 

395 

448 

507 

Evacuate 

• 

• 

• 

77 

61 

40 

60 

Stay 

7  • 

• 

• 

97 

81 

60 

80 

Wait 

• 

• 

• 

348 

395 

448 

507 

Evacuate 

ues  are  rounded 

to  the 

nearest 

unit. 

TABLE  3 


A  Summary  of  M a  lor  Display  Effects  Expressed  In  Percent  Correct 
(Experiment  2) 

A.  OVERALL  ACCURACY 

Stress  Level  ( Updates / sec  ) 

Display  Storm 


Format 

Position 

.6 

1*4 

3.3 

Mean 

Early 

92 

96 

93 

94 

Analog 

Late 

38 

53 

47 

53 

Mean 

75 

75 

70 

Early 

98 

95 

94 

96 

Numeric 

Late 

57 

45 

42 

48 

Mean 

77 

70 

68 

Mean 

76 

72 

69 

(1)  Stress  £(2,30)  -  4.68.  £  -  0.017 

(2)  Format  £(1,30)  -  2.92,  £  -  0.098  (ns) 

(3)  Position  F(l,30)  -  1068.56.  £  <  0.001 

(4)  F  x  S  £(2. 30)  ■  4.92,  £  ■  0.014 

(5)  F  x  P  F( 1 , 30)  -  12.40,  p  -  0.001 

S  x  P  £(2.30)  -  3.92.  n  ■  0.007 


8.  LATE  ACCURACY 

Display 

Format  Order 


Stress  Level  ( Updates/sec ) 


AN 

60 

52 

47 

53 

Analog 

NA 

56 

53 

48 

52 

Mean 

58 

53 

47 

AN 

58 

5  i 

-3 

51 

Numeric 

NA 

55 

38 

41 

45 

(1)  Format  F(l,30)  -  15.47,  £  <  0.001 

(2)  Stress  F(2.30)  ■  11.84,  £  <  0.001 

(3)  F  x  S  F( 2 , 30)  ■  2.11,  £  -  1.39  (ns) 

(4)  F  x  S  x  Order  F(2,30)  ■  3.00,  £  -  0.064  (ns) 


1 

*  I 
» 

| 


TABLE  4 


v 


Summary  of  Major  Sampling  Effects  Expressed  as  the  Number  of  Updates 
Prior  to  a  Terminal  Decision  (Experiment  2) 

A.  ACTUAL  SAMPLING 

Stress  Level  ( Uodates/sec ) 

Display  Trial 


Format 

Block 

.6 

1  .4 

3.3 

Mean 

1 

4.72 

5.04 

5.00 

4.92 

Analog 

2 

a. 86 

5.05 

5.01 

4.91 

3 

4.86 

5.00 

4.88 

a. 91 

Mean 

4.75 

5.03 

4.96 

4.91 

1 

5.17 

4.70 

4.87 

4.91 

Numeric 

2 

3.49 

4.91 

5.09 

5.16 

3 

5.51 

4.72 

5.30 

5.18 

Mean 

5.39 

4.78 

5.08 

5.08 

Mean 

5.07 

4.90 

5.02 

5.00 

(11  Format  x  Stress  F(2,30)  ■  4 .  38 ,  g  ■  0.021 
(2)  F  x  Trials  F<2,60)  -  3.58.  g  -  0.03a 


fc 


.Analog 


Vumeric  2 
3 


.  tS 

i .  -4 

3.3 

Mfan 

l  .02 

1.17 

2.15 

I  .  4S 

.80 

i  .05 

1  .40 

1.08 

1 .82 

.  7  i 

1  .  78 

1  .  44 

1.22 

.98 

i  .78 

1.33 

1.57 

1 .  53 

1.38 

1  .49 

2.17 

1.33 

1.59 

1.70 

2.11 

1.74 

1.48 

1.78 

1.95 

1.54 

1.48 

1  .66 

]  .58 

1.26 

1.63 

1  .*9 

(  i  ) 

Format  F( 1 

,15)  »  3.39,  q  : 

(2) 

F 

X 

Stress 

F(2, 1 5)  -  3.08 

(3) 

F 

X 

Trial s 

F( 2 , 30)  -  7.45 

(*) 

S 

X 

T  F(4. 

30)  m  4.36,  £  < 

(5) 

F 

X 

S  x  T 

F( 4 , 30 )  -  7.22, 

»iS  t  i  ' 


M 


